Searching PAJ 



1/2 ^— V 



PATENT ABSTRACTS OF JAPAN 

(11 publication number : 09-081757 
(43)Date of publication of application : 28.03.1997 



(51)Int.CI. 



G06T 7/60 
B60R 21/00 
B62D 6/00 
G01B 11/00 
G05D 1/02 
G06T 1/00 
G08G 1/16 
H04N 7/1 8 
// B62D101 :00 
B62D137:00 



(21 Application number : 07-238636 
(22)Date of filing: 18.09.1995 



(71 Applicant : MITSUBISHI ELECTRIC CORP 
(72)Inventor : KAJIWARA YASUNARI 




101 



c ioiq r 



7l'01b 



(54) VEHICLE POSITION DETECTING DEVICE 

PRotLEM C T : 0 BE SOLVED: To accurate.y find a vehicle 
poSfon according to only one white line even when ,t ,s 
difficult to detect the white line by ^7""^.. 
position and travel direction of the vehicle about the 
Sine in the lane where the vehicle travels accortmg 
to the position and tilt angle in a road .mage of a straight 
L connecting two points on the white l.ne ,n the road 

SOLUTION: A white line detecting means 101a detects 
two points S2 and S3 on a left-side wh.te line 20 and a 
Chicle state measuring means 1 01 lb .finds 
line L1 connecting the two points S2 and S3, tne 
intersection SI of the straight line L1 and the horizontal 
inZ H on a display screen 1. and the tilt angle 0 of the 
SillTli^th. horizontal line H. Even if the white 
ne ?20 and 30 on the road are hardly detected the 
vehicle position and travel direction can eas.ly be and 
accurately be found from table values read out 

— gth^ - points S2 and S3 on the white line 20 by 

using interpolative operation, etc. 
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[JP.09-081757.A] 
* NOTICES * 



IPO and NCIPI are not responsible for anydamages caused by the use of this translation 
fThirdocumenfhas bee^ ! translated by computer. So the translation may not reflect the ong.nal precisely. 



2 **** shows the word which can not be translated. 
3'ln the drawings, any words are not translated 



CLAIMS 
[Claim (s)] 



Claim 1 An image pick-up means to be carried in a car and to picturize the road .mage ahead of said car A 
white line extract means to calculate at least two on the white line in said road .mage, Car location detection 
CA^I^ a car condition measurement means to measure the location and traveling 
SSS "of saidcar to said white line in the lane said car runs based on whenever [ location / on sa.d road 
imaae of the straight line which connects two on said white line /, and tilt-angle J. 
S 2 Sid carcondition measurement means is car location detection equ.pment a^ord.ng to dam 
Sa acterized by measuring the location and travelling direction of sa.d car based I on ^enever [ location J of 
the intersection of said straight line and underline of the display screen of said road .mage /, and tilt-angle / ot 

rcSrffl An image pick-up means to be carried in a car and to picturize the road image ahead of said car A 
wSinl extS means Z two white lines in said road image to search for at least two points respec .vely. 
^trtogSSSSS each straight line which connected and extended each two on said each wh-te Jje. 
and the horizontal line in said road image, Car location detection equ.pment equipped with a car condition 
^ur«^ mlS?to measure the travelling direction of said car to said white line in the lane sa.d car runs 
based on the location of the top-most vertices to said horizontal line. 

[Clatm 4? Car location detection^ equipment according to claim 3 characterized by measuring , the baton of 
La d Tar based on whenever [ location / of the intersection of one side of said each straight l.ne, and the 
underline of the display screen of said road image /, and tilt-angle / of said straight ine ]. M ^ finn 
rciaim 51 Car location detection equipment given in either from claim 1 equipped with a yaw rate detect.on 
means detect the yaw rate of said car, a vehicle-speed detection means detect the vehicle speed of sa.d car, 
SSiS^pSiSS^ means presume the advance way of said car based on saic yav| r rate and sa d 
vehicle speed, and a lane deviation prediction means predict whether sa.d car devotes from the slow lane in 
^redetermined time based on the advance way of said car to claim 4. 

SSt Ten te ^Hocation detection equipment according to claim 5 which is equipped with a winker 
appearance means to detect the operating state of the winker of said car. j^dltoatami jeans allowing said 
lane deviation prediction means and said winker appearance means, and * ^^f' 2 ^®™ 
means generating an alarm if said winker is not operating when said car is predicted to deviate from said 



Sm 71% is car location detection equipment according to claim 5 which is equipped with a winker 
Lppearance means detect the operating state of the winker of said car, and the travelling direction correction 
means ■following said lane deviation prediction means and said winker appearance means and is 
characterized by for said travelling direction correction means to correct the travelling direction of sa.d car 
aufomaSy so that said deviation condition may be avoided, if said winker is not operatmg when sa.d car .s 
predicted to deviate from said slow lane. 



DETAILED DESCRIPTION 
[Detailed Description of the Invention] 

[nSdof the Invention] This invention relates to the car location detection equipment which raised safety -while 
makin^d^ especially little locations of white line information empty vehicle both about the car location 
detection equipment which detects the location of a self-car based on a front road image. 

rnescliotion of the Prior Art] Drawing 5 and drawing 6 are the explanatory views showing actuation of the 
conventional car foS ?on deteSon equipment indicated by JP.7-128059.A (reference 1). The display screen 
im?ge ahead of [ v^ere 1 was picturized with the mounted video camera (not shown) in drawmg ] 

□ □□(1) 
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SS scanning line divided by the ^ perpendic u^ar from a ^^9^^^ „ detected by 
[0003] In this case, first, as shown in drawing ,5 Chuo Line me slow a horizontal 
detecting the edge of the white hnes 20 and 30 of ' "jJJ^^i ^li between each edge of the 

scanning line, asking for the middle point I ^^^™SK^pSS5 one. Then, each white lines 
white lines 20 and 30 on either s.de, anc > c™"** !^sh 0 LTdrawing 6 R> 6, the car transit location 

on SSES^^ *» ^ ^ 

5SSStK3£2". location cannot be detected. "hen 

Pei in .his case. although fhe car UfdM. g^-** ■»« - ^S^SSJZ 
Uuipped With a side edge detection means detec ' Jjjjj^*" ~ " ^J 3 a fe ne deviation prediction 

ridn^gle) correction means folding a , lane d^«™ P^^a^ travel „ n9 direMlon action 
TX^S^X^^ll^lZ or a fravelllng d,rec«on corrective aodon. 

^,°i d h e e r SSSSiS 2 £ Presumed advance way 44 a, a car 40 and me side edge 43 o. the slow iane 

SoStnaSp— inec .distance ^-^-^^tt^WSS^- 

[0008) in order to realize the above-menuoned ^£nd»ivor 5S«1!5«Mr. since it is necessary to 

Sride edges 42 and 43 o »re ngM-anrMefl '^^^^lons m order to ask for the 

Sn 2 g?e'^^ 

JSSSS JKSSK sides o, a 'car „ke the case o, « 

above-mentioned reference t and reference 2 also in this case. 

ifflm,a„o be Served by ^^TJ^^^^^^^^^ 

ssesesekk h7«s^" tss^m sfrsr * a " chls * emp,y vehlcle 1 suoh 

Lone white line, side edge, or edge, ] both ^^^SfSe^otade angle phi of the presumed 

which can ask for a car location corredly only 2-dimensional road image, lane 

which insurance transit is possible. 

fSS. for SoMng , he Problem, The car ^1^^^^^^,^^^ 

□ □□(2) 



Son / oflhe SS^. 1 ^*!!^ — *» ° f the diS P' ay SCreen ° f 3 ^ ima9e 
SatSSS. the car -ocation detec^ 

means to be carried in a car and to picture he roa I .mage ahead of a ca a ^ ^ ^ Qf ^ 

on two white lines in a road image o sear oh for at ^ast wo poims n p y connecte d and 

top-most vertices to the horizontal line ^JJ^g^^^SSSge, it has a car condition 
extended each two on each white ine and ^^ISm crf^i tothe white line in the lane a car runs, 
measurement means to mea * u ' e £ e ^ °f this invention ™asures the 

SnTa" rJdT aSS - — r" fSSSTSTSTU^-^ of one side of each straight line, 
KSS under^of fhe display o^ jnventjon A yaw rate 

[001 8] Moreover, the car location detecl ^SX^^SS^SmTro claim 4. It has a vehicle speed 
detection means to detect the yaw ra te of a i car in e. ^^ e n ^™ ° ump \, on me ans to presume the 
detection means to detect the vehicle speed of a car an advance way pre p djctjon means to 

advance way of a car based on a yaw rate and the vehic :le speeo, ana a w a F dvance way of a car. 

predict whether a car deviates f rorn Mthe \^JS£SffSS^^ 6 of this invention is equipped with a 
[0019] Moreover, the car location detection equipment c ° nc ™9 ' . d the a)arm mea ns following 

winker appearance means to detect the operating £5^^ln c^'EJ an alarm means 
a lane deviation prediction means and a n w ' n * e ^ from the slow lane, 

generates an alarm, if the winker is not operat ng when, J car is preaiciea equipped with a 

[0020] Moreover, the car location detection Wr"" 1 ^™ ^'g y^ 01 ^ the travelling direction 
winker appearance means detect the operattngj ^^J^^ ^J^'SSimm means, in claim 5. 
correction means following a lane dewhon P^^^^^Z^e slow lane, a travelling direction 

^n^ 



avoided. 
[0021] 



[Embodiment of the Invention] -plained about drawing below gestalt 1 . of operation. 

The gestalt 1 of implementation of this mvention is «P'*"^^ f S^cSalt 1 of operation of this invention, 
Drawing 1 is the block diagram sh 72^^^^^^^ to picturize the road image G 

aSead^ ^ ,0 H Ca r a rG traVe " in9 direCt, ° n 

the same as thai of the above-mentioned, and C "JJ""™^". S of We points from which the underline of the 
intersection of a straight line Lt and a <»™g^"£££SX Ho™ the white line 20 on the left-hand 

Ks^ttJ^^ff^Kfr 5 S3 ' and is,ormed ' and 31 are whenevef 

ine extract means 1 01 a within the car >°<»^«^. n "^i^5e^hto lines 20 and 30 of the 
drawing 2 .and is recognized. Wh. e hneexbact means ™ | J aaon in tne s , ow lane of a car. At 

right-and-left both sides in the display screen 1 in order to ^cognize of linearity which is a part with contrast it 
this time, white lines 20 and 30 are detectable as , a part of the shape * ^earny , P screen ! . 

is brighter than for example J^^^S!^^^^ °ne side in not acquiring 
[0025] However, since white lines 20 and 30 can aeteci on y in something, and they are not 

sufficient contrast by becoming dirty, damaging or going into a i place Deninu so punct iform. 
obtained still more nearly oontinuou S |y by the en^ |jne H 

[0026] Then, white line extract means 10 ^ a _f a k r s e f °^ p a 7S measurement means 101b 

□ □□(3) 
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and tilt-anale / of the straight line L1 to a horizontal line H ]. 

^0271 Here i the camera 100 is carried in the core of a car, the center line C of the display screen 1 wHI be 
in agreement with the core of a camera 1 00. The case where it inclines toward the left-hand s.de in a lane on 
the basis of the condition of running the center line top of a lane now so that a car may become parallel to 
white lines 20 and 30 while the car ran is assumed. . , . 

f00281 As a car inclines toward left-hand side at this time, the intersection S1 of the straight line L1 and 
horizontal line H which approximate the left-hand side white line 20 approaches the center line C inthe 
display screen 1, and theta becomes larger at coincidence whenever [to the horizontal line H of ast a'gnt 
line LI / tilt-angle ]. Therefore, if theta is measured whenever [ location / of an intersection S1 /, and tiit-angie 
1 the car location in the slow lane is detectable. ..... , . . u ■ *~i 

00291 On the other hand, although the location of the intersection S1 of the straight line L1 and horizontal hne 
H which approximate the left-hand side white line 20 will approach the center line C on the display screen 1 .f 
the travelling direction (namely, the direction of a camera 100) of a car assumes the case where it is i not 
parallel and left-hand side has been turned to, to a white line 20, theta becomes small whenever [tilt-ange / 
of a straight line L1 ]. Therefore, if theta is measured whenever [ intersection S1 and tilt-angle ], the travelling 
direction (sense) of not only the car location in the slow lane but a car is detectable. 
[0030] Since parameters, such as whenever [ attaching position / of a camera 1 00 / and c ha t m P' n ^"^J 
and an angle of visibility, are included in measurement of the car condition based on theta it is [ whenever I 
above intersection S1 and tilt-angle ] desirable to store beforehand the combination data of theta . and the car 
location in the slow lane and a travelling direction as a table whenever [ intersection S1 and tilt-angle ] by 

rora^TheS if it is under the situation of being hard to detect the white lines 20 and 30 path on the 
street a car location and a travelling direction can be calculated easily and correctly using a interpolation 
operation etc. from the table value read corresponding to theta whenever [intersection / wh.ch was obtained 
from the straight line L1 on a white line 20 which connects two S2 and S3 / S1 , and tilt-angle ] 
[0032] Thus, the car location and travelling direction (sense) in the slow lane are [ whenever / ^t-angle / ^of 
the st aight line L1 on the white line 20 of one side, for example, left-hand s.de, wh.ch calculates aM^Jt ^| 
S2 and S3, and connects between S2 and S3 two points ] measurable from the location of the intersection S1 
of theta, and the screen underline H, i.e., a horizontal line, and a straight line LI. Therefore, loca ion empty 
vehicle both the locations and sense on the display screen 1 of the straight line L1 wh.ch approximates two 
white lines 20 are detectable as a car condition D. „„„„^*i„„ 
r0033] Although straight-line empty vehicle both the conditions that are gestalt 2. of operat.on of connecting 
L on the white line of one side with the gestalt 1 of the above-mentioned .mplementation were measured 
straiaht-line empty vehicle both the conditions of connecting two each on the white line 20 of both sides and 
30 may be measured. Hereafter, the gestalt 2 of implementation of this invention that measured the car 
conSn baled on two straight lines relevant to the white lines 20 and 30 of both sides is explained, referring 
to the explanatory view of drawing 3 R> 3 with drawing 1 . / 
0034] In drawing 3 . 1 , 20, 30, C H and L1 , S1 -S3, and theta are the same as that of the ^above-ment.oned ( 
Sawing 2 ) The top-most vertices of two points from which S4 and S5 are extracted on the right-hand s.de 
white line 30, the straight line which l_2 connects two-point S4 and S5, and is formed, and the triangle in 
which T includes, Intersection H, i.e., the horizontal line, of straight lines L1 and L2, and U are the 
intersections of the perpendicular and horizontal line H which were given from top-m ^ ^.ces T 
r0035] In this case, white line extract means 101a in drawing 1 calculates two S2 and S3, S4, and S5, even it 
few [ on two white lines 20 of the right-and-left both sides in the road image G, and 30 ] each Moreover car 
condition measurement means 101b forms a triangle by each white line 20, and each straight line LI and I L2 
of each on 30 which connected and extended S2 and S3, S4, and S5 by two points and the horizontal line , H 
in the road image G, and measures the travelling direction of the car to white lines 20 and 30 based on the 
top-most-vertices location U, i.e., the intersection, to a horizontal line H of this triangle. 
[0036] When the white lines 20 and 30 of right-and-left both sides are detectable and two-point S4 on 
two-point S2 and S3, and the right-hand side white line 30 on the left-hand side white line 20 and S5 are 
detected like drawing 3 First, a triangle is formed by the left-hand side straight hne L1 wh.ch connec s two S2 
and S3 the straight line L2 which connects right-hand side two-point S4 and S5, and the horizontal line H, 
and the location on the horizontal line H of top-most vertices T (location of Intersection U) is detected. 
[0037] If the travelling direction of a car is suitable in parallel to white lines 20 and 30 the location of 
Intersection U is in agreement with the center line C of the display screen 1 pictur,* xi with ^am%a \00. 
Moreover if the travelling direction of a car is suitable in the direction of the left-hand side white line 20, the 
location of Intersection U inclines on the right of a center line C like drawing 3 . On the contrary, if the 
travelling direction of a car is suitable in the direction of the right-hand side white line 30. the location of 
Intersection U inclines on the left of a center line C. .. „ 

r0038] Therefore, the travelling direction (sense) of a car is detectable by detecting the location (location on 
the horizontal line H of top-most vertices T) of Intersection U. It can ask for the sense of a car easily and 

□ □□(4) 
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correctly by storing observation data beforehand - of the de teoted car a 

[0039] Furthermore, car «*f™ J^™^^ car , ocatjon and tilt . angle / 

a car ,ocation and the ,ocation of an 

and L2 which approximate the ^^^^^S^^tfZ w^eve? [Wangle / of a straight line 
slow lane can be detected from the '^^^gSS^Jton on the right-hand side white line 30 is 

al ; 0 ^»^ — ° (a ,ocation and sense) can be 

searched for still more correctly . h . ks {or straight | ines L 1 and L2 

Err m 1KT*V*SSKU »nes L1 and L3 using sa-SS Iwo poinls. 

las only measuring the car ° ^ > he | sta „ 2 ot the 

3SSS! ,s explained, ^SSS^SS^SSSi^m^ ( drawing , ). The 
[0043] in drawing 4 , 1 , 10V ?^^^*l S ^f a i a Mh?speed sensor with whioh 103 detects the 
yaw rate sensor to which 102 detects ^e yaw rate V a a i« ™ P E ol a car 

vehicle speed V of a car. The run slate ^f^STSfclfi Sd V The wkrker appearance means. I.e.. 
based on the car condition D, the yaw rate Y. and hj a veh icle sp eeu v. operating slate ol Ihe winker 

,he winker switch, which wll outeutthe wrter J'^^^^l^SS'on'i.e run state E of a oar and 

& a S^^ *• and 108 are ,ravel "" 9 dl,ecuon 

ij'^u^ 

= tSttXXtt^tt&Ztt- deviate, Irom Ihe stew iane in 
predetermined lime based on the presumec I advance ""V"^ ^ ea „ s 108 „,,„ a con trol signal B. and 
[00451 A control unit 106 drives the travelling direction ™™*"° n c „,, d ltion may be avoided while il 

makes a travelling direction correct act Jsignal W is not 

means 101 like Ihe above-mentioned and the car con«on u la roc a. e Mtem ,'„ ls under [ revolution 
Slate [edging equipment ^™^XZT££Sw<Z n?car teeatlon detection means 101 
* and is circling based on the output ^date (car conomon i Moreover, run state iudging equipment 

iSS F— since .he conftgureflon o, .he slow lane » > a„ eady «£tCm3^'-»™ 
slate edging equipment 104 asks for after how many ™ Sbetow predetermined time, 

wrc«^rp^ 

operating and the winker active signal W is ■nputted. ^^''^^fXe a control unit 106 does not output 
iane-changes, or an operator turns and ^^^thSuJ^ oiS aiarm to Inputted, 
control signals A and B, even if the run state fcwn en snou.a w inputted, it is considered 

[0050] However, if a winker does not operate and the wnker actrve s gnai v h ^ ^ 

hat a control unit 106 is a thing wlthout * h J^J^ time, a control unit 

? 0 TcS means 108, and makes 



□ □□(5) 
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lane deviation avoid, while answering the run state E which should be carried out an alarm, outputting control 
signals A and B and generating an alarm from an alarm 107. 

[0051] At this time, either [ at least ] voice or a screen display may be used as an alarm. Moreover, the 
approach of controlling torque allocation of the approach, front wheel, and rear wheel which are automatically 
steered to either [ at least ] a front wheel or a rear wheel as the concrete correction approach of the travelling 
direction of a car, or the method of performing brake control independently to four flowers may be applied. 
[0052] Thus, while asking not only for the car condition D in the slow lane (a location and travelling direction) 
but for the presumed advance way of the yaw rate Y and the vehicle speed V to a car If the winker active 
signal W is not acquired but an operator is judged as there being no volition of lane modification and a turn 
when it judges whether lane deviation may be carried out and the possibility of lane deviation is within 
predetermined time within predetermined time While generating an alarm, a travelling direction is correctable 
so that lane deviation may be prevented. 

[0053] At this time, it sets for the car location detection means 101 . Based on the location of the straight lines 
L1 or L2 on the 2-dimensional road image G, search for the car condition D, and it sets to run state judging 
equipment 104. Since the prediction judging of the possibility of lane deviation of a car is carried out not only 
based on the car condition D but based on the yaw rate Y and the vehicle speed V, data processing 
accompanying detection and a judgment becomes easy, and a cost cut is realizable while promoting 
improvement in the speed and a miniaturization. 

[0054] In addition, although it was made to drive an alarm 107 and the travelling direction correction means 
108 through a control unit 106 with the gestalt 3 of the above-mentioned implementation when there is lane 
deviation possibility of a car if the winker active signal W was not acquired, the run state E which shows 
whether there is any lane deviation possibility may be made to reflect in the drive of the device of other 
arbitration. 

[0055] Moreover, with the gestalt 3 of the above-mentioned implementation, when there is lane deviation 
possibility of a car, although it was made for a control unit 106 to drive both an alarm 107 and the travelling 
direction correction means 108, ** should just drive either [ at least ] an alarm 107 or the travelling direction 
correction means 108. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the outline configuration of the gestalt 1 of operation of this 
invention. 

[Drawing 2] It is the explanatory view showing actuation by the gestalt 1 of implementation of this invention. 
[Drawing 3] It is the explanatory view showing actuation by the gestalt 2 of implementation of this invention. 
[Drawing 4] It is the block diagram showing the outline configuration of the gestalt 3 of operation of this 
invention. 

[Drawing 5] It is the explanatory view showing actuation by the 1st example of conventional car location 
detection equipment. 

[Drawing 6] It is the explanatory view showing actuation by the 2nd example of conventional car location 
detection equipment. 

[Drawing 7] It is the explanatory view showing actuation by the 3rd example of conventional car location 
detection equipment. 
[Description of Notations] 

1 20 Display Screen, 30 White Line, 100 Camera (Image Pick-up Means), 101a white line extract means, 
1 01 b A car condition measurement means, 1 02 Yaw rate sensor, 1 03 A vehicle speed detection means, 1 04 
Run state judging equipment, 105 Winker switch, 106 A control unit, 107 An alarm, 108 Travelling direction 
correction means, A, B control signal, C A center line, D A car condition, E Run state, G Road image, H A 
horizontal line (underline), L1, L2 A straight line, S1 An intersection, S2, S3 Two points, S4, S52 point, T 
Top-most vertices, U An intersection, V The vehicle speed, W A winker active signal, Y A yaw rate, theta 
Whenever [ tilt-angle ]. 
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Publication Title: 

VEHICLE POSITION DETECTING DEVICE 
Abstract: 



PROBLEM TO BE SOLVED: To accura^ 

only one white line even when it is d^cufttode y |n ^ |gne 
the position and travel direction of £ e ^hideaDo^ ^ g ^ jmage 

SSSffl^^ « ^ ,ine in the road image - 

SOLUTION: A white line detecting , mean, , i 01 a 

a left-side white line 20 and a vehicle i state ™ ea | ur,n 9 interS ection S1 of the 
straight line L1 connecting the two points S2 ana a* R e 
Straight line L1 and the ^orizonta I line MH ^^'^.^tf the white lines 20 
&theta of the straight line LI to^K^posifcn and travel direction 
and 30 on the road are hardly detectec tne y? n ' u '« £ read out corresponding 
can easily be and accurately toe obi^etf/om the straight line L1 

SJSScSSSW white ,ine 20 by using interp 

operation, etc. 
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*> t J:tA'3 0^M^i:t» : KttlLWtT.(±' : Sr^^ r^ix^B 

[OOOSlifc. I7lttti(Mf7-1054 
9 8^fg (^i§R2) tclBttS^^*^*^*** 

4 1 «±*M4 0 0>j£fr*«. 4 2 8 i^4 3 (UetiWR 
4 1<0ffl». 4 4<i*B4 0(O«S51 : h-SS. Rtilffl^4 
3fc«iatff»4 4k<0^, *(i:ll^4 3lC«^«.ti 
^ii1fS&4 4c0^r-t^JK'C'S>^ . 
[0006] iW^. ^M4 0 C«ttS*tfc«Wffi« 

it/4 3 **aj-*-*H»«as*sfc . *B4 oo«^a 

ff(|4 4 & «A6«ffBMfBe*»fc . *W4 0<0^T* 

[ooo7] ssffijf ttaiKSrt*^*^^*^ 14 *^ 
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- -jfmttm* oto < i > < 2 > 

ft -r *§-£- - awtfrtftf* £ * 0 aw- ft t»tifiMf 

( l ) *jao4 0OftJ@M l Tft4 4 fc^TOI4 1 colli* 
4 3 fc*)3rttl**0W*fc*J: 0 ^. 

( 2 ) »M4 0 ^ti^iitf ft 4 4 k »iS4 3 k OXjS 
RiTOiBSI**. *S4 0*)*itfcJotTifeJ£3ft.4]Jr 

[0008] JJEW8«t6*fc«3R^»ffi*^^* fc 

[00091 4ft, B»L*n#. ftk i.(f#ra¥7 - 
9 3 6 9 ) t-l^Sftftt^^Mft 

ft. 

[00 10] 

WCt. ;fc&pili«>S»2 0fcJ:tf3(K tt£4 2£J: 
tf4 3 ifclix* : JZmihL%Mxtf*t>%WX\ - 
2r*>S«» pj£4ftli^^^*^*ffiftS£^ 

[00 11] 4ft. Xtt2<o«^fc:ti, mM4 0<o«i5g 
jiff ft 4 4 k 5£ff ** 4 1 AMt 4 2 fe J: V 4 3 k f)« 
'■fltffcfl-JWftfcAK. 
-f ft k ^ o puasa** "5 ft . 

[0 0 12] i«»W4±IB«>J:a*IMMit»ft-f* 
ft#>C3:$*i.ftk<9T:\ Lt>SSOI!0>a»£1*iB"$"ft 

ik^a^k-ri.. 

[0013] 4ft. z&jtnwmmzm-? < itmm 

&£k£BWfc-fft. 
[00 14] 

iWr< k 1 2 A* ft e»ttiiJ#Rfc . SSSLk<0 2 jft 



j; tfatfWj m & itiU-r ft wwawwwa t * * *. ft *> 
<ryxfoh, 

[0015] 4ft. - nwwwm 2 eft & *M(iS 

[0016] 4ft. i«)5HB^I*fl3(CiR*«PM(Ui 
?ti'J?%< k i 2A5:*i'>-SeStttB#Sk . =S-B&± 

IcifT & JjiM^itfi^ l^l * tt*W" ft *H*»K**R k 
£di.fti> coTab 4. 

[0017] 4ft. Cl<0^<OiS*3S4lw^S*MfflS 
£ftB«<^^iBM^T&k03oft7>ftSk . 

h. 

[0018] 4ft. Clco^o»«iB5tc^l)*Mfit§ 
^til^S<4 , t*^« 1 4 4 T'cot ^-fit*»fc*J 

k. *M<oma[^«?aj-rs«aEKaj^k. a-i^-v- 
*s ct i/mm izm^ mmv>m?f ft sr*s-r s attf »« 

^#Sk. ^M^ilSftt-*'^' 1 '^^ fift^iafi^M 
#Kk£<ifi.fti>w:'£>ft. 

[0019] 4ft. d<0»W0M*«6fcCRS*l«ffl« 

Jo ±tf <7 -f y^^ttl^RCKUrf-ftSfS^fSk ifflli . 
WR^BMi . *M A«*ff ittK"^ ft t ^ * 

k * to < lt v^rimr. #«Sr^-rft 
[0020] 4ft. c: toffe H J<7)f* 7 c$ ft mMiaa 
uwftaia-r*^ -< y*«Bfi#s k . «bu»»s 

^Dii. iltf^"l*l1^iE*Rt±. *M* J ^T*»A»'9iiMK 
ft k ?iift k # C»7 tX v W. 

icigiE-rft^^t'^ft. 

[002 1] 
[%Bfl<7)^f£^®] 

^XWftt ft . El 1 ttC<03*W5iat<OJBJB 1 «0tHa&*i 
^*^-T7'p •/ ^0T"*> 0.10 0tt*Wt:«»S*LT 
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[0022] *P5ffiWftiB#» 101l±. i!KH*Grt 

<?>&m±.<?>'J?%< 1 1 2jft«r«K>*e»*ai#a i o i 

a fc SMLW> 2 j££»*i«ft<^B&H«G±«>fiW3 

wsj:t«ff*rt> «w*4«wh»w*Ri o i 

bfc&SS-ttVS. 

[00 2 31 02tf>BWH0**8BLfc* t ^ 01 
h. 02fcfcV^t, 1. 2 0fc«fct/ r 3 0t±H'J5£fcR&< ; '> 

icOT&D, cot/r^?ioowwyc«a"*"*«^B 
s2fcj;y : s3{±Bffi*iii^>e^2 o±-cttaj$*t«>2 

* Lltt2jSS2«J:U r S3**S^JS*S*tiB: 
Si* S UJit»Llfc* 3 r t *Hfc<0«&. 0t±ltt»Ll 

[0 0 24] ±i\ ft^^^l OOfcJ:->TJMUS 
^SMmrtr^jSSSHffiGJi, *Bfi£S&iB*a l o l 

s^bs i kioTWtsw . e«»aj#a iou 
ffiirto£*Misi^e^2 0fcj;iA'3o$:^ai-r^. - 

<Dk#, S;&2 0fcJ:l>'3 0li, fcfcitf, JSffliB*£ 

B® 1 «T*fc<ait48»««»*t LT^HJ-f 6 - 
fc 

[0025] U>»U S»2 0fcJ:tf3 014, aW*tt 

[0026] -e-r-e, a«tta#aio uii 

If, j£BI<oa*2 0±«)2jftS2*JiI/S3*ttajL. 
*PI*nitWfR lOlbli. 2 *S 2 fc <fctf S 3 

L 1 fc , S£L 1 k fl^Bffi 1 O^TOH fc COX 

As i fc . *¥»hk*«-*ii*l i (DteMftme fc £ 

[0027] idt 1 , 0 #mBc04"H4ctg» 

sfi-cv^ifc-rtLif. «saiHi«) |! W>i»c(±, 

100tf)4"l>fc— frfSCfc£&&. «B#fii£ 
2 0 fc J: 3 0 K*f LTW fc i ? 

[0028] Z.<r>b%. *B#:£l!HCfrSittf>vff S(i 
fc\ £«oa»2 0 fcifiKTfcttfcL i 
35* S ltJ^Bffilrt^+'DfactCjfi-^^, RB#t;z, 

Patent provided by Sughrue Iv 



[0029] SWAiSffifrfl (-fSr^. 7 

i o o*tfn*j> a«e»2 ot»uffft«4<£iic 
i*ivvc ^ £ffl^a^2o^3sm-r 

*]£»L 1 fc* 3 F»H fc<7)^S 1 tfOftStiSI^Bnn 1 

ii^r&] < a * > «:t*aj-r s £ t * . 

[0030] JJW)* 3 &££S 1 fc J:tf 

sox*B^^i«£fc^^ 5 1 o o«orot 
<? k , ^m&fl w*B<asfc xiF&rmft fc 

[003 1 ] £*LfcJ:9» iiK±C0a^2 0fc.fctf3 0 
*M»{BH=<wK8lTTft->-Cfc. SI»20±«>2jSS 
2fc<fcT/S SSrSS-WtHL l*»fc»fcft*:3^S 1*5 ± 

* ffl v ^ #Baafc j: xmttfo * ®% ^s- 

ojESilc^*^) S £ fc i> . 
[0032]<LOJ:o^ frMfc fc i«£H«>e» 2 0 
icD^-SKfc fc2jftS2t*J:^S3ft*«>. 2*S2fc 
XX/ S 3^5r^it^L 1 <7)ffiM^S<9 fc . BflBTSl-r 
^^*^Hfclt^L 1 kc03e,6S lOGiSfc*^, 

a:^L i <73*tkB® i ±«ftB*»fe*n*a* i^t 6 '^ 
j$sfs.D fc urwaj-r* £ fc ^> • 

[0033] mM<r>MB2 . 5ri3. ±M?mm<V&B 1 T 
(±frBl^a«Lh^ 2^^^fflM*^*Btt^.^fi-i!lL 
tr*-\ Bffl^S^2 0 fc XXf3 0±«0*2^Sr^-Jili^ 
^fe«P5«HB*»«IU-Ct,J:v\ KIT, Hlfcfct.^0 
3O1&0J1I2£:#B3L*A*^ Pi«OfiJt2 0fcJ:t^3 0 
C~M31t- !» 2*c0iEISCS^'^-C*B«ffi2ri+ift | i-t«'«t . 

[0 034] @3CfcV^s 1. 20, 30, C, H, 
LI, S l~S3fcJ:2/^{4fi3i (02) fcl§l«cotcO 

x-h o , S48WS5 ti^raicoaia 3 o ±t*kb $ ^ 

6 2jft! L2«2jaS4»J:lfS5tl6^»JfiSil* 
ffia T(itt^LlfcJ:t>'L2Wx.^^^*^ H 

**tr SftS*tf>ia jft , U(iif*T^ feT Lfc*»k *¥• 
^HfcWjc*-Ci5l). 

[0035] £o*&. Eiirt<oa«ttaj*ai o 1 a 

(i 3IKBaGrt«0£tl«IHW> 2 O<0S*R 2 0 fc X Xf 3 
0±^-5-^'^^< k*» 2 ^- S 2fcit>'S 3 fc S4fc 
XU-S 5 fc S«f>4. «H«a»KB*Rl 0 1 b 

i, PLLC - http://www.sughrue.com 



(5) 



ftRPF9-8 1 7 57 



(1 ^tQm20»Xl/30±mMtLff)2AS2»X 
& itf L 2 tMIgGrt^*^ H t lei 
^UCS^^« e»2 0fcj:a f 3 0fc*«-4*pil 

[0 0 3 6] S3WJ:3K:. £*fflffl*>fi»2 0Bit>* 
3 0 jWfcffi WC* o T . £H*>S» 2 0 _htf> 2.6 S 2 
fc«}:tfS3k, *|goai»3 0±O2jSS4tJit/S5 
fc^ajSiUt*^!. *1\ SM«02j*S2J3J:lf 
■ S3*tM**Llfc* *W<0 2jSiS4*JJ:tfS5£f£ 
.Mfi«L2i:. #¥»Hi:fcJ: l JHfl#£#J£U 

[ 0 0 3 7 ] i> t . mWOjKfftfffltfBa^ OfcAtf 3 
OCttLTWCft^^tfUl 3b£U<7>{5:Itl 

9io o-caMfe?^*^ws i co4"C^c fc— sc-r 

^3 0c7)^lct6]^TV''ixtt\ ^CJ&UOftfid 

[0038] LtzW^x. S!jsuwtaat (H*t^*¥ 
^H±c7)^a> sr^-n^k^o. *Po*>atfT*i*i 
) £&aj-r?>.rk# : -e£&. £<a*&<»« 9QRr 

_^ $ .^_ 7 vKgt LXhbfr t^S^^> <I k C <k 
0, *WAfl££r^fcS^IEiIfc*tf>S^ka J T# 

[00391 ? fc(C, tfHttlBfHH^R 1 0 1 b(l & 
ajSftfc*B<Z>ffl££^7*-:?k l/C\ *M&SklS 

[004 0] .LOcfcofc. ^WIIJcoa^2 0*3j:tA'3 
0 *jfi«r 6 2*WlfmL 1 J:r/L 2 <50^jSUcO<5« 

*ow>e«3o«>flHiifcfflv^-cv^*«>"c, mmco 

&mibifr<-X. *ffttJBD (ftBfcJ:lXfi£) £$fe 
KjEIB d k I) . 

[004 1] ZZX'li. «-e*I2 0*JJ:t/3 0±c7)#2 
d6rS2~S5S-fflV^Ti^L ltiitfL 2 
#3*UUi^fflV\-CiE^Llt>J:l>'L2$rjf<^. *Pi& 

[0042] m^<r>mm 3 . . jje^ss^jb® 1 & 

J:tf±EWiW>»»2TI4. SIS 2 OBJ: t>' 3 0«3^ 
ff)'J?%< k t-^r<?5B«flH8*ffl''^*H : KJIBD ({SMt 



UTF. 04coro-y^[l$r#S?.U^A^. 
12 * tetti»ff*l*I* IE*P5 k tSSft-T 6 J: 5 C Ufc £ 05* 

[0 04 3] H4C*JWC. 1. 101. Dfcit/Gti 

mse (0i ) trnmnitcoxh*) . io2ii*B<o3- 

tmvtrtHtiSthVSA^y^^ 10 4Ua(WWBD. 3 
- W- h Y £> «t yt*IVCi^ ^tfM^tSE 5: 

< yaatas^BW-srfcfc* < >-#*4 1 0 6t±m 

«ffi*Afe±t/B£ffl#*-**!«K»s 10 7J±IWW« 
Hf-AtiOBftStL***^^ 10 8t±lMWfflW-Bfc: 

[0044] ifelf «0Bf JjaSB 104(1 0wL3r^ 
*M«MD, 3-U-hY*5«fctfl£3[VC*-*,vt 

a. 

[00451 S'JfcPiSB 106(1 rffttSE(:I-5^t 

/ck * O -f y*ffttfi*W*«»<5,n*JifLtf . MWa 
^ACJrOWKfai 0 7*B»UT*«S«±«*4 
k HC. «««^ B (3 £ 0 «fT^m«iE#S 1 0 8 Sr 
HSU L . «K&Ktt)B& <fc 3 (Cilff^r&I $: e» 

[0046] uza^x. oi&xvmtt 

GrtEE#& 1 0 8{±. 1 0 6 Sr^- LX . **r* 

JDWI^S 10 4 rt^jMRWWBb^feWfe**.*^* 

[0047] ^-T> WJfik|3HIM=, ^5100t« 
UfcilHiB«G ^«P«SKB*ffi*a 101 -c^s b . * 

gi 04ii *p«a«*ai¥Ri 0 lA^oas^T-^ 

|^ ( 3 _ - h Y ) k ICSo% ->"C . Wffitftiiz® tpirE 

seff 1 0 4i±. laMio 3^ 

[0048] 5 fee 3err«HB9jaMi 1 0 4(4. a» 
T-mti&mjmfT&^m^x . mmzwteim, 

1 0 6Caj*"^i. 
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[0049] tilfllgXl 06ti. jfcffttJBEfc 

fcofcJMr*-. Ufc^-J-C. fHWSStl 0 6«±» »*W 
COO 5 0] L*»U feU ^-r^j&WWUtisfe 

gai o 6Ji. aig^^asse^frrtKifr^sSie** 

»ff*m«iE#a i o 8tcj: «)atfi#iai£e»wfcfl5E 
[0051] ssst lx\±. ^paxz/mm 

MLxiijLizyu-^mm^ifomm^Mm^tin 

[0052] t<T> i. o 3feff«»rtO*pi|«JBD ([5 
•5. 

[0053] ci^t#. mwfi[*^aj*si o ijcjsv* 



[ 0 0 5 4 ] sflris. Ji!Bafc<0»JB3Tti. *PS*>*« 

4rfiiitf . $OT^a 1 0 6 zrtf- LTSISSB 1 0 7 fei 
V"jlff^r(6l^IE#S 10 8 arill!)-r h XoiZ Lfctf. * 

[ 0 0 5 5 ] ±fc. ±!S«fcW»!B3T«, ISM?)*!* 
j6K-Br«tt* t *'6«^t=. WtBSill 0 6AWBSI1 

0 7 J:tf «fr#l*11fciE#R 1 0 8<^W^€r «W * <£ 
d Ltitf . 1 0 7 *3 ctl^aifi 3f |6H£E¥R 

1 0 8^3r< t>— 2r*ffilW"*tff 
[HifitfHMt&BMH] 

[Hi] c <owmMm<r>&m i ^fifB&^^$:7nt-y 

u-y?0-C'J>S. 

[02 ] ZW&tynmifc&BB 1 l=i 
Hj!0-e£>&. 

[03] £«o«ffl<0»*«WB»2fc±4»ffc***tt 

[04] < lc0%HB^)IIS6<O^®3^«P«fl}^S:>r:i"^ 
n«y^0t'JbS. 

[05] «a«o«iitiw*ai«««» i owKi s» 
[06] ^*^*w{aa^tu^a^m 2 <o«t= i 4 » 

f^$r7n - t1K B J0"Cib-l> . 

[07] tS*^mM(2B«tU^awSI 3 «o Wfc: i 
1 8^1®, 2 0. 3 0 filSL 100 (« 

«^s) .101 aaaaaai^R. 101b 

ttSI^-R. 102 3— U— Mrf9\ 103 
ffi#R. 1 0 4 jfeff «JBW5®B«. 10 5 •> -f y* 
X>f-yf-. 106 MUM. 107 S^^a. 10 
8 3ifT#ffl«IE#R. A. B©Jffllfl#. C +it«. 
D «P94UB. E ^fi 1 *^. G ilSSHfiL H 
tft(T») - L1.L2 Hi. SI S2. S 

3 2j£u S4. S5 2j^„ T Utft, U ^> V 
«X, W *7 -f ViJ^mm^. Y B-ly-h. a ft 
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[06] 



[07] 
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